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Arkansas Better Chance (ABC) Program Longitudinal Study (2009-2017) 


Persistent academic achievement gaps continue to challenge education systems (Bower, 
2011; Duncan & Magnuson, 2005; Reardon & Portilla, 2015). In an attempt to address these 
gaps before they become pervasive, states have implemented state-funded preschool 
programs (Lee & Burkam, 2002; Magnuson & Waldfogel, 2016; Pianta & Howes, 2009). A main 
goal of all state-funded preschool programs is the preparation of young children for 
Kindergarten and elementary school. Effective preschool programs lay a foundation for 
children’s subsequent school success by imparting the varied knowledge, abilities, and 
dispositions children need to succeed in school. 


Previous research has established that high-quality and well-funded preschool programs 
make valuable contributions to improving children's learning and development (Barnett, 2002; 
Young, 2016) and have a valuable economic return (Heckman, 2006, 2011; Karoly, 2016). 
Studies of model prekindergarten programs including the Abecedarian Early Childhood 
Intervention program, the High/Scope Perry Preschool program, and the Chicago Child-Parent 
Centers have shown that these types of programs produce economic benefits that are much 
greater than their costs (Barnett, 1996; Masse & Barnett, 2002; Reynolds, Temple, Robertson, & 
Mann, 2002). The benefits of preschool education include higher scores on achievement tests 
and lower rates of special education placements and grade repetition, as well as longer-term 
effects such as improved high school graduation rates and reduced levels of crime and 
delinquency (Camilli, Vargas, Ryan, & Barnett, 2010; Ramey, Campbell, Burchinal, Skinner, 
Gardner, & Ramey, 2000; Reynolds, Temple, Robertson, & Mann, 2001). 


Although state-funded preschool programs are not as well funded as many of the model 
programs that have been intensively studied, the state programs are larger and serve more 
diverse populations. As state-funded preschool programs grow and more children participate, it 
is increasingly important to determine how effective these programs are in improving children’s 
potential for school success. 


The Arkansas Better Chance (ABC) Preschool Program Context 


In Act 49 of the Second Extraordinary Session of 2003, the Arkansas State Legislature 
expanded the Arkansas Better Chance (ABC) prekindergarten program and provided explicit 
instruction to target school districts in which at least 75 percent of children have literacy and 
math scores below proficient levels. This report examines the impact of the ABC program on 
the percent of children scoring proficient on the state’s end-of-year exams. 


Arkansas is a recognized, national leader in the standards it has set for its programs in 
seeking to provide quality preschool experiences. Using a variety of tools, it has a robust 
Quality Rating Improvement Scale (QRIS) that examines classroom environment, teacher 
education and professional development, administrative effectiveness and efficiency, and 
teacher-child interactions. Additionally, Arkansas updated its Child Development and Early 
Learning Standards in 2016, with support and guidance from education professionals and 
national experts. Together, these resources create a high-quality state-funded prekindergarten 
program. 
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This report demonstrates the effects of the Arkansas Better Chance program (ABC) on 
end of year assessments, which varied over the course of the study years. Seven preschool 
cohorts (2009-2015) are included. For the earliest cohort (2009) late elementary (third through 
fifth grades) and middle school (sixth through ninth grades) outcomes were examined, while for 
the most recent cohort (2015), only third grade outcomes are examined. Students included in 
the ABC cohorts were enrolled in ABC the year prior to Kindergarten, enrolled in Arkansas 


public schools for consecutive years associated 
Table 1. Cohort Counts 


with the cohort’s reporting period, and ABC 


received free lunch all years of the reporting K 438 3,151 
period. Students included in the No Known 3 280 1,806 
PreK cohorts were consecutively enrolled in 3009 a 262 1,687 
Arkansas public schools for all years associated z = nena 
ae y 6 224 1,430 
with the cohort’s reporting period, received 7 212 1,343 
free lunch all years of the reporting period, and K 617 3,371 
had no PreK participation indicated on their 3 368 1,726 
Kindergarten registration forms. 2010 4 328 1,526 
5 298 1,425 
A limitation of this study is that it is 6 282 1,362 
possible children with private preschool K 767 3,917 
experiences have been included in the ‘No 2011 3 zo 1,978 
K Prek’ (NK) stud duet ss = = 
nown Pre study group due to 5 a7 1716 
incomplete Kindergarten registration data, K 693 A504 
resulting in inflated NK percent proficient. 2012 3 397 2,325 
4 363 2,173 
Methodology K 4,207 4,090 
208 3 2,984 1,989 

An input file containing a list of Arkansas : : 
Better Chance (ABC) students was provided to 2 : ena aoe 
Arkansas Department of Education (ADE) with 2015 e__4.887 | 4288 
rkansas Department of Education ( ) wi 3 3703 2,642 
ABC research identifiers for match to the ADE 2016 K 5,132 4,696 
data system for student enrollment and 2017 K 5,794 5,829 


assessment. ADE provided research identifiers 

for all students and included the ABC research identifier for any student which was also found 
on the ABC input file. ADE returned data files as output, with one file for each academic year of 
student enrollment and assessment. Dozens of output files were combined to generate the 
dataset for this study. 


In order to establish the study cohorts, rules were established to identify the ABC cohort 
and the No Known (NK) PreK cohort within the combined ABC and ADE data. To be included in 
this study, children must have been five years old at the time of entering Kindergarten or clearly 
attending Kindergarten for the first time, must be present in ADE data on or after October 1 of 
every applicable year, and must have been enrolled in free lunch program every applicable 
year. For the ABC cohort, children must have attended an ABC program for seven hours or 
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more per day in the year prior to their Kindergarten entry. For the NK cohort, children must not 
have any PreK indicator on their ADE record as completed by their parent/guardian at the time 
of Kindergarten registration, nor may they have been enrolled ABC for less than seven hours 
per day. For the purposes of this study, only children who received free lunches for all relevant 
years were included. PreK cohorts were established for ABC and NK students from 2009 to 


2017. 


Beginning with the 2013 PreK year, the number of ABC students increased significantly, 
and the corresponding third grade testing results are associated with the 2017 assessment. 
PreK cohorts for 2014 and 2017 are students who have not yet reached the third grade. 
Comparison groups for Free Meals, ABC PreK, and No Known PreK were established for each 
PreK cohort, with counts as shown in Table 1. Figure 1 demonstrates the process in which the 
initial cohorts were established and reflects the relative size of each reporting pool. 


Figure 1. Selection Criteria 
PreK Type © ABC @No Known PreK — Other PreK 


Full Price & iY) @ @ 
Reduced 
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PreK Year 


The 2017 statewide ABC cohort was fairly evenly split between genders, while the NK cohort 
had more boys (Figure 2). Similarly, distribution of race remained fairly constant between the 
two cohorts, although the ABC cohort had slightly more Black and Hispanic children (Figure 3). 


Figure 2. 


ABC Gender Distribution NK Gender Distribution 
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Figure 3. 
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Results 


The results of the longitudinal study are promising for the Arkansas Better Chance 
program. Frequently, ABC students perform better on state assessments than children who did 
not attend ABC PreK. An important note for analysis of these results is the change in 
assessments over the study period. The Arkansas Benchmark test was used in 2013 and 2014, 
the PARCC was used in 2015, and the ACT Aspire was used 2016 and on. 


The 2009 ABC cohort had statistically more students score proficient than the No Known 
PreK (NK) cohort in reading (2013, 2014, 2015, 2019) and math (2013, 2014, 2015), but not in 
science. 


2009 Cohort RLA Percent Proficient 
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The 2010 ABC cohort did not have statistically more proficient children than the No Known PreK 


cohort. 
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The 2011 ABC cohort did not have statistically more proficient children than the No Known PreK 


cohort. 
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The 2012 ABC cohort did not have statistically more proficient children than the No Known PreK 


cohort. 
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The 2013 ABC cohort had statistically more proficient children on all tests in the third grade 
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Retention 


Significant differences in the retention rates of the ABC cohorts and the No Known (NK) 
PreK cohorts provide an additional insight into student proficiency. Because retained students 
are no longer on-time in terms of their enrolled grade level, they should be recognized in the 
evaluation of proficiency and program effectiveness. Table 2 shows the cumulative retention of 
each PreK cohort through its 2017 grade. 


Table 2. Retention Rates 


Retention 

PreK Cohort | 2019 Grade ABC Retention NK Retention Difference 
2009 7 22.3% 18.5% -3.8% 
2010 6 19.7% 19.1% -0.6% 
2011 5 13.4% 16.9% 3.5% 
2012 4 11.9% 16.7% 4.8% 


The retention rate is higher for NK PreK cohorts, with as many as 4.8% more retained 
students in 2017 for the 2012 PreK cohort which would have been in the fourth grade, if not 
retained. Recognizing that an additional 4.8% NK students were not proficient at the on-time 
grade level, the differences between ABC and NK are particularly stark through elementary 
school. The 2013 PreK Cohort for third grade in 2017 was not included because the study data 
set contains no corresponding standardized test data for retained students in the second grade. 
The number of students promoted into a grade higher than their peers is statistically 
insignificant for both ABC and NK cohorts. 


ABC Outcomes 12 


Conclusion 


The Arkansas Better Chance program has an income requirement for eligibility. Children 
living in homes with greater than 200% of the federal poverty level are ineligible to participate 
in the program, unless they meet other at-risk factors (special needs, teenage mothers, etc.). 
Moreover, ABC serves more children of color than the general population. In spite of the risk 
factors and a pervasive academic achievement gap, students who attend ABC programs often 
are performing better on state assessments and have lower retention rates through fifth grade 
than children who have not participated in a PreK program. 


The change in testing instruments does appear to have impacted outcomes for the 
middle cohorts but seems to be stabilizing in the later cohorts. This is not an unexpected 
fluctuation as children and schools adjust to new instruments. The 2013, 2014, 2015 ABC 
cohorts each demonstrated higher rates of proficiency (within larger cohorts) on at least one of 
the end-of-year assessments than the No Known PreK cohort. Additionally, the retention rates 
for the 2011 and 2012 cohorts are 3.5% to 4.8% lower for ABC, indicating significantly more ABC 
students are remaining on-time with their peers. These results have promising implications for 
future ABC cohorts. 
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ABC Cohort Outcomes for Free Lunch Students 


- The ABC Cohort includes all first-time, free lunch Kindergarteners in the 2009-2010 academic year who were enrolled in 
districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2009-2019 and were enrolled in 
the ABC program the previous year. 

- The NK (No Known) Cohort includes all first-time, free lunch Kindergarteners in the 2009-2010 academic year who were 
enrolled in districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2009-2019 and did 
not indicate PreK enrollment upon Kindergarten entry. 

- Average Score represents on-time students tested. 

- Proficiency represents on-time Proficient or Advanced students out of all regularly tested students in each academic year. 


2009 ARKANSAS 


Assessment Pre-K Measure Grade 3 (2013) Grade 4 (2014) Grade 5 (2015) Grade 6 (2016) 
Program - (Benchmark) i (Benchmark) (PARCC) A (ACT Aspire) 

MATH ABC Average Score 280 578.0 262 593.4 238 722.6 224 419.7 
Proficiency 83.6% 68.7% 50.0% 50.0% 

MATH NK Average Score 1,806 570.5 1,687 589.2 1,534 715.4 1430 8419.3 
Proficiency 78.1% 63.7% 39.9% 45.5% 

RLA ABC Average Score 280 604.4 262 683.2 238 728.3 224 422.1 
Proficiency 77.9% 78.6% 55.5% 46.9% 

RLA NK Average Score 1,806 579.4 1,687 668.6 1,533 718.8 1,430 421.6 
Proficiency 69.3% 73.0% 47.4% 45.5% 

SCI ABC Average Score 239 192.6 224 420.1 
Proficiency 43.9% 37.9% 

SCl NK Average Score 1,540 189.9 1432 419.6 
Proficiency 42.2% 37.9% 
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ABC Cohort Outcomes for Free Lunch Students 


- The ABC Cohort includes all first-time, free lunch Kindergarteners in the 2010-2011 academic year who were enrolled in 
districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2010-2019 and were enrolled in 
the ABC program the previous year. 

- The NK (No Known) Cohort includes all first-time, free lunch Kindergarteners in the 2010-2011 academic year who were 
enrolled in districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2010-2019 and did 
not indicate PreK enrollment upon Kindergarten entry. 

- Average Score represents on-time students tested. 

- Proficiency represents on-time Proficient or Advanced students out of all regularly tested students in each academic year. 


2010 ARKANSAS 


Assessment Pre-K Measure Grade 3 (2014) (eT e-to(-w- 710) A)) (eT e-lo(-wom 10h I) Grade 6 (2017) 
Program ie (Benchmark) (PARCC) fs (ACT Aspire) i (ACT Aspire) 

MATH ABC Average Score 368 567.2 328 722.1 298 416.7 282 420.1 
Proficiency 78.3% 42.7% 40.3% 48.9% 

MATH NK Average Score 1,726 570.6 1,526 721.2 1,425 416.7 1,362 420.6 
Proficiency 78.0% 45.6% 39.6% 54.8% 

RLA ABC Average Score 368 579.1 328 726.2 298 420.2 282 422.7 
Proficiency 72.6% 52.7% 38.6% 50.0% 

RLA NK Average Score 1,726 579.4 £526 7253 1425 420.2 1363 422.9 
Proficiency 69.6% 54.4% 39.5% 53.4% 

SCI ABC Average Score 298 417.0 282 419.2 
Proficiency 21.1% 29.4% 

SCl NK Average Score Lvs ANAT) 1362 419.8 
Proficiency 27.9% 37.1% 
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ABC Cohort Outcomes for Free Lunch Students 


- The ABC Cohort includes all first-time, free lunch Kindergarteners in the 2011-2012 academic year who were enrolled in 
districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2011-2019 and were enrolled in 
the ABC program the previous year. 

- The NK (No Known) Cohort includes all first-time, free lunch Kindergarteners in the 2011-2012 academic year who were 
enrolled in districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2011-2019 and did 
not indicate PreK enrollment upon Kindergarten entry. 

- Average Score represents on-time students tested. 

- Proficiency represents on-time Proficient or Advanced students out of all regularly tested students in each academic year. 


2011 ARKANSAS 


Assessment Pre-K Measure Grade 3 (2015) (eT e-to(-w- 710) I) Grade 5 (2017) 
Program (PARCC) PF (ACT Aspire) fs (ACT Aspire) 

MATH ABC Average Score 455 722.6 421 414.9 397 416.8 
Proficiency 50.1% 41.1% 39.5% 

MATH NK Average Score 1,978 721.6 1,810 414.8 1,716 416.8 
Proficiency 51.8% 42.7% 42.2% 

RLA ABC Average Score 455 716.5 421 418.0 397 420.9 
Proficiency 43.3% 29.7% 45.3% 

RLA NK Average Score La 714.6 1,810 417.8 1,716 420.7 
Proficiency 40.0% 27.7% 44.5% 

SCI ABC Average Score 421 415.7 397 417.8 
Proficiency 25.7% 28.0% 

SCl NK Average Score Lsi2. 45.5 1,716 417.8 
Proficiency 25.7% 28.7% 
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ABC Cohort Outcomes for Free Lunch Students 


- The ABC Cohort includes all first-time, free lunch Kindergarteners in the 2012-2013 academic year who were enrolled in 
districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2012-2019 and were enrolled in 
the ABC program the previous year. 

- The NK (No Known) Cohort includes all first-time, free lunch Kindergarteners in the 2012-2013 academic year who were 
enrolled in districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2012-2019 and did 
not indicate PreK enrollment upon Kindergarten entry. 

- Average Score represents on-time students tested. 

- Proficiency represents on-time Proficient or Advanced students out of all regularly tested students in each academic year. 


2012 ARKANSAS 


Assessment Pre-K Measure Grade 3 (2016) (eT e-to(-w- 710) A) 
Program 5 (ACT Aspire) Fi (ACT Aspire) 

MATH ABC Average Score 397 411.7 363 415.1 
Proficiency 46.6% 44.4% 

MATH NK Average Score 2,325 411.9 2,173 415.0 
Proficiency 45.3% 43.4% 

RLA ABC Average Score goF 415.4 363 418.4 
Proficiency 24.9% 33.1% 

RLA NK Average Score 2,324 415.6 2,173 418.6 
Proficiency 24.6% 35.9% 

SCI ABC Average Score 398 412.3 363 415.9 
Proficiency 23.9% 28.4% 

SCI NK Average Score 2,331 413.0 2,175 416.2 
Proficiency 24.2% 31.4% 
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ABC Cohort Outcomes for Free Lunch Students 


- The ABC Cohort includes all first-time, free lunch Kindergarteners in the 2013-2014 academic year who were enrolled in 
districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2013-2019 and were enrolled in 
the ABC program the previous year. 

- The NK (No Known) Cohort includes all first-time, free lunch Kindergarteners in the 2013-2014 academic year who were 
enrolled in districts of the Arkansas Department of Education and received Free Lunch for ALL of the years 2013-2019 and did 
not indicate PreK enrollment upon Kindergarten entry. 

- Average Score represents on-time students tested. 

- Proficiency represents on-time Proficient or Advanced students out of all regularly tested students in each academic year. 


2013 ARKANSAS 


Assessment Pre-K Measure Grade 3 (2017) 
Program (ACT Aspire) 


n 
MATH ABC Average Score 2,984 412.5 
Proficiency 51.8% 

MATH NK Average Score 1,989 412.2 
Proficiency 48.4% 

RLA ABC Average Score 2,984 416.3 
Proficiency 32.5% 

RLA NK Average Score 1,989 415.8 
Proficiency 30.2% 

SCI ABC Average Score 2,984 413.7 
Proficiency 29.0% 

SCI NK Average Score 1,990 413.3 
Proficiency 26.4% 
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